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Summary 

It is proved that the average length of standard confidence intervals for parameters of 
, gamma and normal distributions monotonically decrease with the sample size. The proofs 

^ . are based on fine properties of the classical gamma function. 
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1 Introduction and Lemmas 



In recent issues of the Bulletin of the IMS (see IShil ( l2008l ). iDasGuptal ( l2008l )). a discussion 
was held on the behavior of standard estimators of parameters as functions of the sample 
size n. If R{6n, 0) is the risk of an estimator On constructed from a sample of size n, a very 
desirable property of On would be 

R{0n+1^0)<R{0n^0) (1) 

for all 0. Unfortunately, even when ([1]) holds, it is very difficult to prove it for more or less 
general class of estimators and/or families. 



One of few examples of classical estimators with a monotonically (in n) decreasing risk is the 
Pitman estimator of a location parameter. Let (Xi, . . . be a sample from population 
F{x—6) and let t„ = t„ (Xi, . . . , X„) be the Pitman estimator corresponding to an (invariant) 
loss function L{6, 9) = L{6 — 6). The corresponding risk R{6n) of any equivariant estimator 
6n is constant in 6 and by the very definition of t„, R{tn) > R{tn+i) for any F. More deeper 
result holds for the Pitman estimator corresponding to the quadratic loss L{9 — 6) = {6 — 6Y. 
If j x^dF(x) < oo, then for any n, Var(tn) < oo and 



nVar{tn) > (n + l)Var{tn+i). 



(2) 



Artstein et al. 



The proof of ( ED in iKagan et al\ ( 120111 ) is based on a lemma of general interest from 



20041) ■ The inequali ty was used in studying a geometric property of the 



sample mean in iKagan and Yul ( l2009l ) . 

Turning to the interval estimation of parameters, one finds a very natural loss function, 
namely the length of a confidence interval. Here we study the risk, i.e., the average length 
of the standard confidence intervals for the scale parameter /3 of a gamma distribution 
Gamma (a, (5) and for the mean /i and variance cr^ of a normal distribution A^(/i, cr^). Though 
our results are new, to the best of our knowledge, their interest is more methodological 
than applied. Notice, however, that the distributions we study are often used in different 
applications. 

It is proved that the average length of the standard confidence interval of a given level 
1 — a monotonically decreases with the sample size n. Though the monotonicity seems a 
very natural property, the proofs are based on fine properties of the gamma function and 
are nontrivial. 

We write X ~ Gamma (a, /3) if the probability density function of X is 

1 



f{x;a,l3) 



(3''T{a 



-X 



a-l-x/l3 



X > 0, a > 0, /3 > 0. 



(3) 



Lemma 1. Let Xi ~ Gamma {ai, f3i) , X2 ~ Gamma {a2, (32) ■ If cli < 0,2, Pi > P2, there 
exists a unique x* = x* {ai,a2, Pi, P2) such that the distribution functions Fi of Xi, and F2 
of X2 have the following properties: 

Fi (x) > F2 {x) for X < X* and Fi (x) < F2 [x) for x > x*. (4) 

Proof. Plainly, if ai < a2, Pi > P2, then 

fix-ai,Pi) ^ f{x-ai,Pi) ^ ^_ 
f {x;a2, P2) /(x;a2,/32) 

Thus, for sufficiently small x, say x < Xi, Fi (x) > F2 (x) and for for sufficiently large x, say 
X > X2, one has 1 — Fi (x) > 1 — F2 (x), so that Fi (x) < F2 (x). Therefore, there is a point 
X* with Fi (x*) = F2 (x*). We shall show that such an x* is unique. 

Take now the ratio o-i, Pi) ^ ^ai-a2^-x(i/i3i-i/i32) ^ j^-g Jog-derivative (with respect to x), 
/(x;a2,/32) 

^'^ vanishes at the only point xq = — r-^ — "TTT- -^^ ^" '^ith x' < x" 



X \Pl P2J u 

be two points with /(x';ai,/3i) = f {x';a2, P2) and /(x";ai,/3i) = / (x"; 02, /32). Plainly, 



x' < Xq < x" and for all x G (x', x") one has 

/(x;ai,/3i) 



< 1- (6) 



/(x; a2,/32) 

Since for x < x', Fi (x) > F2 (x) and for x > x", 1 — Fi (x) > 1 — F2 (x), any x with 

Fi (x) = F2 (x) must satisfy x' < x < x" . If there are two points xj and X2 with Fi (x*) = 

F2 (x*) , i = 1,2, then by virtue of the RoUe theorem, there is a point xq G (xi,X2) with 

F/ (xo) - F2' (xo) = / (xo; ai. Pi) - f (xq; a2, P2) = 0, i.e., = 1. However, for all 

/ {xo;a2,P2) 

X G (x',x"), the inequality ([6]) holds. The contradiction proves the uniqueness of x* with 
Fi(x*) = F2(x*). □ 

For a special case of semi -integers Oi , ay, (i. e., for the chi-squared distribution) the result 



of Lemma [T] was obtained in 



Szekely and Bakirovl (120031 ) by different arguments. 
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Figure 1: The critical values of a* as a function of n 

Since Fi{x*) = F2{x*) = a* = a*{ai,a2, (32), say, the following is a straightforward 
Corollary of Lemma [1] 

Corollary 1. If '~fai,i3,;a is the quantile of order a of Gamma [at, Pi) ,i = 1,2, then for 

a < a*, 7ai,/3i;a < 7a2,/32;a ^.''^d 7ai,^i;l-Q > 7a2,/32;l-a- 

The next Lemma deals with a fine property of the classical gamma function. 



Lemma 2. For any a; > 0, 



+ 1/4 < 



T{x+1) 



r(x + i/2) 

Proof . For an integer x, ([7]) was proved in 



(7) 



(119841 ). 



LorchI (119841 ) and for an arbitrary x in 



Laforgia 



□ 



Many useful inequalities for the gamma function are in a recent paper 



Laforgia and Natalini 



( I2OIII ). We shall need ([7]) for semi-integer x. 
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2 Mean Length of Confidence Intervals 



2.1 Confidence interval for tiie scale parameter of gamma distri- 
bution 

Let now (Xi, X2, . . . , X„) be a sample from a population Gamma (a, /3) with a known shape 
parameter a and a scale parameter (5 to be estimated. The sum Yll=i -^i ~ Gamma {na, (3) 



is a sufficient statistics for /3 and the ratio ~ Gamma {na,l) is a pivot leading 
to the standard confidence interval for (3 of level 1 — a, ( — , ~~ )• average 

\lna;l~a/2 lna:al2 ) 

length is L„ = /3 ( — ) , where ^na- a/2 is the quantile of order a 12 

\lna;a/2/na lna;l-a/2 1 na J 

of Gamma {na, 1). 

If Gi{x) is the distribution function of Xj ~ Gamma{ai,l), i = 1,2, then for ai < 02, 

Gi{x) > G2{x) (equivalently, Xi is stochastically smaller than X2). Therefore, 7ai;a < 7a2;a 
for all a, < a < 1. In particular, 

7na;a < 7(n+l)a;Q- (8) 

The quantile of order a of Gamma {na,l/na) is '~fna;a/'na and its relation to the quantile 
1{n+i)a;a/{n + l)a differs from (jS]). The following result holds. 

Theorem 1. For a < a*{n,a), Ln+i < Ln- 

Proof. By virtue of Corollary [T] applied to the case of Oi = na, (3i = 1/na, 02 = (n + l)a, (32 = 

l/(n + l)a one gets 

1 1,1 1 , , 

< — and — - > — , (9) 



l{n+l)a;a/2/in+ l)a lna;a/2/na 7{n+l)a; l-a/2/('^ + l)a lna;l~a/2 / na 

for a < a*{n,a). The result follows immediately from ([9]). □ 

As a function of n for a given a, a*{n,a) grows very fast (see Figured]). An interesting 
fact is that if the sample means X„, and Xn+i calculated from samples of size n and n + 1, 



are the same, the confidence interval ( - — — — ^ — - — — — ^ — ) of level 1 — a for the 



.7(n+l)a; l-a/2 7(n+l)a;a/2 

scale parameter /3, lies inside the interval 



,7na;l-Q/2 lna;a/2 , 

Note that Theorem [T] also holds for an asymmetric confidence interval. Namely, let 
tti + «2 = a, then the average length of the confidence interval ( — , — — ^ J is a 



'~1na; l~a2 '~1na\ ai 



decreasing function of n. 



A standard (one-sided) lower confidence bound of level 1 — a for the parameter /3 is 
The statistician is interested in having (for a given level 1 — a) a larger lower 



7f"i; 1— 

bound. From Corollary [1] for a < a* it follows that E ( ~] — ~~i — is an 

\7na;l— a/ '~1na\l~a I 

increasing function of n. 

2.2 Confidence Interval for the Normal Variance 

Let now (Xi, X2, . . . , X^) be a sample from a normal population (/i, o"^) with /i and o"^ as 
parameters. The standard confidence interval of level (1 — a) for o"^ is 

{n-l)Sl {n-l)si 



2 ' 2 

^n-l;l-a/2 A„_1;q,/2 



(10) 



where S'^ is the sample variance and x\-i-a/2 quantile of order a/2 of chi-square 

distribution with n — 1 degrees of freedom. The average length of the interval (fTOj) is 



( ^5 -77 r o —r, r I • If ~ X^, then X/d ~ Gamma ^) 



and again Corollary [T] is applicable. Thus, for a < a *(n), monotonicity o: 



Ln+i- A table of the values of a*{n) can be found in 
sake of completeness a graph of a*{n) is drawn in Figure | 

2.3 Confidence Interval for the Normal Mean 

The standard Student confidence interval of level 1 — a for // is 



Szekely and Bakirovl (j2003[ ). For the 



L n ho lds, Ln > 



~ tn-l;a/2—^ , -^n + a/2 1 ; (H) 
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Figure 2: The critical values of a* as a function of n 

where td-a is the quantile of order 1 — a of the Student distribution with d degrees of freedom. 
The average length L„ of f lTTj) is easily calculated, 



Ln = 2V2a tn-i-a/2En, where E„ 



r(n/2) 



(12) 



T{{n-l)/2)^n{n-iy 
The quantile td-a monotonically decrease in d. This presumable known fact can be easily 
proved along the lines of Lemma [T] Indeed, let Z ~ A^(0, 1) and ^„ ~ Xn/^ be independent 
random variables. Then for any c > 0, 

P (^-|= >c^=e!^P (^-|= > c I I = {P (e„ < Z'/c^ \Z)}>E{P < Z^c^ I Z) 



ElP 



Z 



> c\Z 



P 



Z 



> c 



where independence of Z and ^„ (^n+i) and Corollary [1] are used. To prove that En > En+i 
take first the left inequality from Lemma [2l One has 



E, 



T{n/2) 



1 r((n-2)/2 + l) 



> 



T((n-l)/2) ^n(n-l)r((n-2)/2 + l/2) - 1) 



72-2 1 



4' 

(13) 
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The right inequahty from Lemma [2] imphes 

^ 1 r((n + l)/2) _ 1 r((n-l)/2 + l) ^ 1 " ^ |~ 

^n{n + l) T{n/2) + 1) r((n - l)/2 + 1/2) + 1) V 2 2' 

(14) 

Now comparing the right hand sides of fll3p and fll4l) resuhs in En > -En+i for n > 3. For 
77, = 2, 3, the inequahties E2 > E^ > £'4 follow from the explicitly calculated values of E2, E3, 
and -E4. 
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